Unraveling COVID-19: a large-scale characterization of 4.5 million COVID-19 cases using CHARYBDIS (preprint)

Background: Routinely collected real world data (RWD) have great utility in aiding the novel coronavirus disease (COVID-19) pandemic response [1,2]. Here we present the international Observational Health Data Sciences and Informatics (OHDSI) [3] Characterizing Health Associated Risks, and Your Baseline Disease In SARS-COV-2 (CHARYBDIS) framework for standardisation and analysis of COVID-19 RWD.Methods: We conducted a descriptive cohort study using a federated network of data partners in the United States, Europe (the Netherlands, Spain, the UK, Germany, France and Italy) and Asia (South Korea and China). The study protocol and analytical package were released on 11th June 2020 and are iteratively updated via GitHub [4]. Findings: We identified three non-mutually exclusive cohorts of 4,537,153 individuals with a clinical COVID-19 diagnosis or positive test, 886,193 hospitalized with COVID-19, and 113,627 hospitalized with COVID-19 requiring intensive services. All comorbidities, symptoms, medications, and outcomes are described by cohort in aggregate counts, and are available in an interactive website: https://data.ohdsi.org/Covid19CharacterizationCharybdis/. Interpretation: CHARYBDIS findings provide benchmarks that contribute to our understanding of COVID-19 progression, management and evolution over time. This can enable timely assessment of real-world outcomes of preventative and therapeutic options as they are introduced in clinical practice.

Characteristics and outcomes of 118,155 COVID-19 individuals with a history of cancer in the United States and Spain (preprint)

PurposeWe aimed to describe the demographics, cancer subtypes, comorbidities and outcomes of patients with a history of cancer with COVID-19 from March to June 2020. Secondly, we compared patients hospitalized with COVID-19 to patients diagnosed with COVID-19 and patients hospitalized with influenza. MethodsWe conducted a cohort study using eight routinely-collected healthcare databases from Spain and the US, standardized to the Observational Medical Outcome Partnership common data model. Three cohorts of patients with a history of cancer were included: i) diagnosed with COVID-19, ii) hospitalized with COVID-19, and iii) hospitalized with influenza in 2017-2018. Patients were followed from index date to 30 days or death. We reported demographics, cancer subtypes, comorbidities, and 30-day outcomes. ResultsWe included 118,155 patients with a cancer history in the COVID-19 diagnosed and 41,939 in the COVID-19 hospitalized cohorts. The most frequent cancer subtypes were prostate and breast cancer (range: 5-19% and 1-14% in the diagnosed cohort, respectively). Hematological malignancies were also frequent, with non-Hodgkins lymphoma being among the 5 most common cancer subtypes in the diagnosed cohort. Overall, patients were more frequently aged above 65 years and had multiple comorbidities. Occurrence of death ranged from 8% to 14% and from 18% to 26% in the diagnosed and hospitalized COVID-19 cohorts, respectively. Patients hospitalized with influenza (n=242,960) had a similar distribution of cancer subtypes, sex, age and comorbidities but lower occurrence of adverse events. ConclusionPatients with a history of cancer and COVID-19 have advanced age, multiple comorbidities, and a high occurence of COVID-19-related events. Additionaly, hematological malignancies were frequent in these patients.This observational study provides epidemiologic characteristics that can inform clinical care and future etiological studies.

Use of dialysis, tracheostomy, and extracorporeal membrane oxygenation among 240,392 patients hospitalized with COVID-19 in the United States (preprint)

Objective To estimate the proportion of patients hospitalized with COVID-19 who undergo dialysis, tracheostomy, and extracorporeal membrane oxygenation (ECMO). Design A network cohort study. Setting Six databases from the United States containing routinely-collected patient data: HealthVerity, Premier, IQVIA Open Claims, Optum EHR, Optum SES, and VA-OMOP. Patients Patients hospitalized with a clinical diagnosis or a positive test result for COVID-19. Interventions Dialysis, tracheostomy, and ECMO. Measurements and Main Results 240,392 patients hospitalized with COVID-19 were included (22,887 from HealthVerity, 139,971 from IQVIA Open Claims, 29,061 from Optum EHR, 4,336 from OPTUM SES, 36,019 from Premier, and 8,118 from VA-OMOP). Across the six databases, 9,703 (4.04% [95% CI: 3.96% to 4.11%]) patients received dialysis, 1,681 (0.70% [0.67% to 0.73%]) had a tracheostomy, and 398 (0.17% [95% CI: 0.15% to 0.18%]) patients underwent ECMO over the 30 days following hospitalization. Use of ECMO was generally concentrated among patients who were younger, male, and with fewer comorbidities except for obesity. Tracheostomy was used for a similar proportion of patients regardless of age, sex, or comorbidity. While dialysis was used for a similar proportion among younger and older patients, it was more frequent among male patients and among those with chronic kidney disease. Conclusion Use of dialysis among those hospitalized with COVID-19 is high at around 4%. Although less than one percent of patients undergo tracheostomy and ECMO, the absolute numbers of patients who have undergone these interventions is substantial and can be expected to continue grow given the continuing spread of the COVID-19.

Highly functional virus-specific cellular immune response in asymptomatic SARS-CoV-2 infection (preprint)

The efficacy of virus-specific T cells in clearing pathogens involves a fine balance between their antiviral and inflammatory features. SARS-CoV-2-specific T cells in individuals who clear SARS-CoV-2 infection without symptoms or disease could reveal non-pathological yet protective characteristics. We therefore compared the quantity and function of SARS-CoV-2-specific T cells in a cohort of asymptomatic individuals (n=85) with that of symptomatic COVID-19 patients (n=76), at different time points after antibody seroconversion. We quantified T cells reactive to structural proteins (M, NP and Spike) using ELISpot assays, and measured the magnitude of cytokine secretion (IL-2, IFN-{gamma}, IL-4, IL-6, IL-1{beta}, TNF- and IL-10) in whole blood following T cell activation with SARS-CoV-2 peptide pools as a functional readout. Frequencies of T cells specific for the different SARS-CoV-2 proteins in the early phases of recovery were similar between asymptomatic and symptomatic individuals. However, we detected an increased IFN-{gamma} and IL-2 production in asymptomatic compared to symptomatic individuals after activation of SARS-CoV-2-specific T cells in blood. This was associated with a proportional secretion of IL-10 and pro-inflammatory cytokines (IL-6, TNF- and IL-1{beta}) only in asymptomatic infection, while a disproportionate secretion of inflammatory cytokines was triggered by SARS-CoV-2-specific T cell activation in symptomatic individuals. Thus, asymptomatic SARS-CoV-2 infected individuals are not characterized by a weak antiviral immunity; on the contrary, they mount a robust and highly functional virus-specific cellular immune response. Their ability to induce a proportionate production of IL-10 might help to reduce inflammatory events during viral clearance.

Unheeded SARS-CoV-2 protein? Look deep into negative-sense RNA (preprint)

SARS-CoV-2 is a novel ssRNA+ virus from the Coronaviridae family, which has caused the global COVID-19 pandemic. The genome of SARS-CoV-2 is one of the largest of RNA viruses, comprising of 26 known protein-coding loci. This study aimed to explore the coding potential of negative-strand RNA intermediate for its potential to contain additional protein coding-loci. Surprisingly, we have found several putative ORFs and one brandt new functional SARS-CoV-2 protein-coding loci and called it Avo1 (Ambient viral ORF1). This sequence is located on negative-sense RNA intermediate and bona fide coding for 81 amino acid residues long protein and contains strong Kozak sequence for translation on eukaryotic ribosomes. In silico translated protein Avo1 has a predominantly alpha-helical structure. The existence of Avo1 gene is supported also by its evolutionarily and structural conservation in RaTG13 bat coronavirus. The nucleotide sequence of Avo1 also contains a unique SREBP2 binding site which is closely related to the so-called cytokine storm in severe COVID-19 patients. Altogether, our results suggest the existence of still undescribed SARS-CoV-2 protein, which may play an important role in the viral lifecycle and COVID-19 pathogenesis.

A Novel Cell Therapy for COVID-19 and Potential Future Pandemics: Virus Induced Lymphocytes (VIL) (preprint)

The a priori T cell repertoire and immune response against SARS-CoV-2 viral antigens may explain the varying clinical course and prognosis of patients having a mild COVID-19 infection as opposed to those developing more fulminant multisystem organ failure and associated mortality. Using a novel SARS-Cov-2-specific artificial antigen presenting cell (aAPC), coupled with a rapid expansion protocol (REP) as practiced in tumor infiltrating lymphocytes (TIL) therapy, we generate an immune catalytic quantity of Virus Induced Lymphocytes (VIL). Using T cell receptor (TCR)-specific aAPCs carrying co-stimulatory molecules and major histocompatibility complex (MHC) class-I immunodominant SARS-CoV-2 peptide-pentamer complexes, we expand virus-specific VIL derived from peripheral blood mononuclear cells (PBMC) of convalescent COVID-19 patients up to 1,000-fold. This is achieved in a clinically relevant 7-day vein-to-vein time-course as a potential adoptive cell therapy (ACT) for COVID-19. We also evaluate this approach for other viral pathogens using Cytomegalovirus (CMV)-specific VIL from donors as a control. Rapidly expanded VIL are enriched in virus antigen-specificity and show an activated, polyfunctional cytokine profile and T effector memory phenotype which may contribute to a robust immune response. Virus-specific T cells can also be delivered allogeneically via MHC-typing and patient human leukocyte antigen (HLA)-matching to provide pragmatic treatment in a large-scale therapeutic setting. These data suggest that VIL may represent a novel therapeutic option that warrants further clinical investigation in the armamentarium against COVID-19 and other possible future pandemics.

Characteristics, outcomes, and mortality amongst 133,589 patients with prevalent autoimmune diseases diagnosed with, and 48,418 hospitalised for COVID-19: a multinational distributed network cohort analysis (preprint)

Objective: Patients with autoimmune diseases were advised to shield to avoid COVID-19, but information on their prognosis is lacking. We characterised 30-day outcomes and mortality after hospitalisation with COVID-19 among patients with prevalent autoimmune diseases, and compared outcomes after hospital admissions among similar patients with seasonal influenza. Design: Multinational network cohort study Setting: Electronic health records data from Columbia University Irving Medical Center (CUIMC) (NYC, United States [US]), Optum [US], Department of Veterans Affairs (VA) (US), Information System for Research in Primary Care-Hospitalisation Linked Data (SIDIAP-H) (Spain), and claims data from IQVIA Open Claims (US) and Health Insurance and Review Assessment (HIRA) (South Korea). Participants: All patients with prevalent autoimmune diseases, diagnosed and/or hospitalised between January and June 2020 with COVID-19, and similar patients hospitalised with influenza in 2017-2018 were included. Main outcome measures: 30-day complications during hospitalisation and death Results: We studied 133,589 patients diagnosed and 48,418 hospitalised with COVID-19 with prevalent autoimmune diseases. The majority of participants were female (60.5% to 65.9%) and aged [≥]50 years. The most prevalent autoimmune conditions were psoriasis (3.5 to 32.5%), rheumatoid arthritis (3.9 to 18.9%), and vasculitis (3.3 to 17.6%). Amongst hospitalised patients, Type 1 diabetes was the most common autoimmune condition (4.8% to 7.5%) in US databases, rheumatoid arthritis in HIRA (18.9%), and psoriasis in SIDIAP-H (26.4%). Compared to 70,660 hospitalised with influenza, those admitted with COVID-19 had more respiratory complications including pneumonia and acute respiratory distress syndrome, and higher 30-day mortality (2.2% to 4.3% versus 6.3% to 24.6%). Conclusions: Patients with autoimmune diseases had high rates of respiratory complications and 30-day mortality following a hospitalization with COVID-19. Compared to influenza, COVID-19 is a more severe disease, leading to more complications and higher mortality. Future studies should investigate predictors of poor outcomes in COVID-19 patients with autoimmune diseases.

Baseline characteristics, management, and outcomes of 55,270 children and adolescents diagnosed with COVID-19 and 1,952,693 with influenza in France, Germany, Spain, South Korea and the United States: an international network cohort study (preprint)

Objectives To characterize the demographics, comorbidities, symptoms, in-hospital treatments, and health outcomes among children/adolescents diagnosed or hospitalized with COVID-19. Secondly, to describe health outcomes amongst children/adolescents diagnosed with previous seasonal influenza. Design International network cohort. Setting Real-world data from European primary care records (France/Germany/Spain), South Korean claims and US claims and hospital databases. Participants Diagnosed and/or hospitalized children/adolescents with COVID-19 at age <18 between January and June 2020; diagnosed with influenza in 2017-2018. Main outcome measures Baseline demographics and comorbidities, symptoms, 30-day in-hospital treatments and outcomes including hospitalization, pneumonia, acute respiratory distress syndrome (ARDS), multi-system inflammatory syndrome (MIS-C), and death. Results A total of 55,270 children/adolescents diagnosed and 3,693 hospitalized with COVID-19 and 1,952,693 diagnosed with influenza were studied. Comorbidities including neurodevelopmental disorders, heart disease, and cancer were all more common among those hospitalized vs diagnosed with COVID-19. The most common COVID-19 symptom was fever. Dyspnea, bronchiolitis, anosmia and gastrointestinal symptoms were more common in COVID-19 than influenza. In-hospital treatments for COVID-19 included repurposed medications (<10%), and adjunctive therapies: systemic corticosteroids (6.8% to 37.6%), famotidine (9.0% to 28.1%), and antithrombotics such as aspirin (2.0% to 21.4%), heparin (2.2% to 18.1%), and enoxaparin (2.8% to 14.8%). Hospitalization was observed in 0.3% to 1.3% of the COVID-19 diagnosed cohort, with undetectable (N<5 per database) 30-day fatality. Thirty-day outcomes including pneumonia, ARDS, and MIS-C were more frequent in COVID-19 than influenza. Conclusions Despite negligible fatality, complications including pneumonia, ARDS and MIS-C were more frequent in children/adolescents with COVID-19 than with influenza. Dyspnea, anosmia and gastrointestinal symptoms could help differential diagnosis. A wide range of medications were used for the inpatient management of pediatric COVID-19.

Baseline phenotype and 30-day outcomes of people tested for COVID-19: an international network cohort including >3.32 million people tested with real-time PCR and >219,000 tested positive for SARS-CoV-2 in South Korea, Spain and the United States (preprint)

Early identification of symptoms and comorbidities most predictive of COVID-19 is critical to identify infection, guide policies to effectively contain the pandemic, and improve health systems' response. Here, we characterised socio-demographics and comorbidity in 3,316,107 persons tested and 219,072 persons tested positive for SARS-CoV-2 since January 2020, and their key health outcomes in the month following the first positive test. Routine care data from primary care electronic health records (EHR) from Spain, hospital EHR from the United States (US), and claims data from South Korea and the US were used. The majority of study participants were women aged 18-65 years old. Positive/tested ratio varied greatly geographically (2.2:100 to 31.2:100) and over time (from 50:100 in February-April to 6.8:100 in May-June). Fever, cough and dyspnoea were the most common symptoms at presentation. Between 4%-38% required admission and 1-10.5% died within a month from their first positive test. Observed disparity in testing practices led to variable baseline characteristics and outcomes, both nationally (US) and internationally. Our findings highlight the importance of large scale characterization of COVID-19 international cohorts to inform planning and resource allocation including testing as countries face a second wave.

Clinical characteristics, symptoms, management and health outcomes in 8,598 pregnant women diagnosed with COVID-19 compared to 27,510 with seasonal influenza in France, Spain and the US: a network cohort analysis (preprint)

OBJECTIVES: To describe comorbidities, symptoms at presentation, medication use, and 30-day outcomes after a diagnosis of COVID-19 in pregnant women, in comparison to pregnant women with influenza. DESIGN: Multinational network cohort SETTING: A total of 6 databases consisting of electronic medical records and claims data from France, Spain, and the United States. PARTICIPANTS: Pregnant women with [≥] 1 year in contributing databases, diagnosed and/or tested positive, or hospitalized with COVID-19. The influenza cohort was derived from the 2017-2018 influenza season. OUTCOMES: Baseline patient characteristics, comorbidities and presenting symptoms; 30-day inpatient drug utilization, maternal complications and pregnancy-related outcomes following diagnosis/hospitalization. RESULTS: 8,598 women diagnosed (2,031 hospitalized) with COVID-19 were included. Hospitalized women had, compared to those diagnosed, a higher prevalence of pre-existing comorbidities including renal impairment (2.2% diagnosed vs 5.1% hospitalized) and anemia (15.5% diagnosed vs 21.3% hospitalized). The ten most common inpatient treatments were systemic corticosteroids (29.6%), enoxaparin (24.0%), immunoglobulins (21.4%), famotidine (20.9%), azithromycin (18.1%), heparin (15.8%), ceftriaxone (7.9%), aspirin (7.0%), hydroxychloroquine (5.4%) and amoxicillin (3.5%). Compared to 27,510 women with influenza, dyspnea and anosmia were more prevalent in those with COVID-19. Women with COVID-19 had higher frequency of cesarean-section (4.4% vs 3.1%), preterm delivery (0.9% vs 0.5%), and poorer maternal outcomes: pneumonia (12.0% vs 2.7%), ARDS (4.0% vs 0.3%) and sepsis (2.1% vs 0.7%). COVID-19 fatality was negligible (N<5 in each database respectively). CONCLUSIONS: Comorbidities that were more prevalent with COVID-19 hospitalization (compared to COVID-19 diagnosed) in pregnancy included renal impairment and anemia. Multiple medications were used to treat pregnant women hospitalized with COVID-19, some with little evidence of benefit. Anosmia and dyspnea were indicative symptoms of COVID-19 in pregnancy compared to influenza, and may aid differential diagnosis. Despite low fatality, pregnancy and maternal outcomes were worse in COVID-19 than influenza.

Heterogeneity and temporal variation in the management of COVID-19: a multinational drug utilization study including 71,921 hospitalized patients from China, South Korea, Spain, and the United States of America (preprint)

Objectives: A plethora of medicines have been repurposed or used as adjunctive therapies for COVID-19. We characterized the utilization of medicines as prescribed in routine practice amongst patients hospitalized for COVID-19 in South Korea, China, Spain, and the USA. Design: International network cohort Setting: Hospital electronic health records from Columbia University Irving Medical Centre (NYC, USA), Stanford (CA, USA), Tufts (MA, USA), Premier (USA), Optum EHR (USA), department of veterans affairs (USA), NFHCRD (Honghu, China) and HM Hospitals (Spain); and nationwide claims from HIRA (South Korea) Participants: patients hospitalized for COVID-19 from January to June 2020 Main outcome measures: Prescription/dispensation of any medicine on or 30 days after hospital admission date Analyses: Number and percentage of users overall and over time Results: 71,921 people were included: 304 from China, 2,089 from Spain, 7,599 from South Korea, and 61,929 from the USA. A total of 3,455 medicines were identified. Common repurposed medicines included hydroxychloroquine (<2% in NFHCRD to 85.4% in HM), azithromycin (4.9% in NFHCRD to 56.5% in HM), lopinavir/ritonavir (<3% in all US but 34.9% in HIRA and 56.5% in HM), and umifenovir (0% in all except 78.3% in NFHCRD). Adjunctive medicines were used with great variability, with the ten most used treatments being (in descending order): bemiparin, enoxaparin, heparin, ceftriaxone, aspirin, vitamin D, famotidine, vitamin C, dexamethasone, and metformin. Hydroxychloroquine and azithromycin increased rapidly in use in March-April but declined steeply in May-June. Conclusions: Multiple medicines were used in the first months of COVID-19 pandemic, with substantial geographic and temporal variation. Hydroxychloroquine, azithromycin, lopinavir-ritonavir, and umifenovir (in China only) were the most prescribed repurposed medicines. Antithrombotics, antibiotics, H2 receptor antagonists and corticosteroids were often used as adjunctive treatments. Research is needed on the comparative risk and benefit of these treatments in the management of COVID-19.

Characteristics and outcomes of 627 044 COVID-19 patients with and without obesity in the United States, Spain, and the United Kingdom (preprint)

Background: COVID-19 may differentially impact people with obesity. We aimed to describe and compare the demographics, comorbidities, and outcomes of obese patients with COVID-19 to those of non-obese patients with COVID-19, or obese patients with seasonal influenza. Methods: We conducted a cohort study based on outpatient/inpatient care, and claims data from January to June 2020 from the US, Spain, and the UK. We used six databases standardized to the OMOP common data model. We defined two cohorts of patients diagnosed and/or hospitalized with COVID-19. We created corresponding cohorts for patients with influenza in 2017-2018. We followed patients from index date to 30 days or death. We report the frequency of socio-demographics, prior comorbidities, and 30-days outcomes (hospitalization, events, and death) by obesity status. Findings: We included 627 044 COVID-19 (US: 502 650, Spain: 122 058, UK: 2336) and 4 549 568 influenza (US: 4 431 801, Spain: 115 224, UK: 2543) patients. The prevalence of obesity was higher among hospitalized COVID-19 (range: 38% to 54%) than diagnosed COVID-19 (30% to 47%), or diagnosed/hospitalized influenza (15% to 48%) patients. Obese hospitalized COVID-19 patients were more often female and younger than non-obese COVID-19 patients or obese influenza patients. Obese COVID-19 patients were more likely to have prior comorbidities, present with cardiovascular and respiratory events during hospitalization, require intensive services, or die compared to non-obese COVID-19 patients. Obese COVID-19 patients were also more likely to require intensive services or die compared to obese influenza patients, despite presenting with fewer comorbidities. Interpretation: We show that obesity is more common among COVID-19 than influenza patients, and that obese patients present with more severe forms of COVID-19 with higher hospitalization, intensive services, and fatality than non-obese patients. These data are instrumental for guiding preventive strategies of COVID-19 infection and complications

Risk of depression, suicidal ideation, suicide and psychosis with hydroxychloroquine treatment for rheumatoid arthritis: a multi-national network cohort study (preprint)

ABSTRACT Objectives Concern has been raised in the rheumatological community regarding recent regulatory warnings that hydroxychloroquine used in the COVID-19 pandemic could cause acute psychiatric events. We aimed to study whether there is risk of incident depression, suicidal ideation, or psychosis associated with hydroxychloroquine as used for rheumatoid arthritis (RA). Methods New user cohort study using claims and electronic medical records from 10 sources and 3 countries (Germany, UK and US). RA patients aged 18+ and initiating hydroxychloroquine were compared to those initiating sulfasalazine (active comparator) and followed up in the short (30-day) and long term (on treatment). Study outcomes included depression, suicide/suicidal ideation, and hospitalization for psychosis. Propensity score stratification and calibration using negative control outcomes were used to address confounding. Cox models were fitted to estimate database-specific calibrated hazard ratios (HR), with estimates pooled where I 2 <40%. Results 918,144 and 290,383 users of hydroxychloroquine and sulfasalazine, respectively, were included. No consistent risk of psychiatric events was observed with short-term hydroxychloroquine (compared to sulfasalazine) use, with meta-analytic HRs of 0.96 [0.79-1.16] for depression, 0.94 [0.49-1.77] for suicide/suicidal ideation, and 1.03 [0.66-1.60] for psychosis. No consistent long-term risk was seen, with meta-analytic HRs 0.94 [0.71-1.26] for depression, 0.77 [0.56-1.07] for suicide/suicidal ideation, and 0.99 [0.72-1.35] for psychosis. Conclusions Hydroxychloroquine as used to treat RA does not appear to increase the risk of depression, suicide/suicidal ideation, or psychosis compared to sulfasalazine. No effects were seen in the short or long term. Use at higher dose or for different indications needs further investigation. TRIAL REGISTRATION Registered with EU PAS; Reference number EUPAS34497 ( http://www.encepp.eu/encepp/viewResource.htm?id=34498 ). The full study protocol and analysis source code can be found at https://github.com/ohdsi-studies/Covid19EstimationHydroxychloroquine . WHAT IS ALREADY KNOWN ON THIS TOPIC Recent regulatory warnings have raised concerns of potential psychiatric side effects of hydroxychloroquine at the doses used to treat COVID-19, generating concern in the rheumatological community Serious psychiatric adverse events such as suicide, acute psychosis, and depressive episodes have been identified by the US Food and Drug Administration (FDA) adverse events reporting system and at case report level WHAT THIS STUDY ADDS This is the largest study on the neuro-psychiatric safety of hydroxychloroquine to date, including >900,000 users treated for their RA in country-level or private health care systems in Germany, the UK, and the US We find no association between the use of hydroxychloroquine and the risk of depression, suicide/suicidal ideation, or severe psychosis compared to sulfasalazine HOW MIGHT THIS IMPACT ON CLINICAL PRACTICE Our data shows no association between hydroxychloroquine treatment for RA and risk of depression, suicide or psychosis compared to sulfasalazine. These findings do not support stopping or switching hydroxychloroquine treatment as used for RA due to recent concerns based on COVID-19 treated patients.

Can we trust the prediction model? Demonstrating the importance of external validation by investigating the COVID-19 Vulnerability (C-19) Index across an international network of observational healthcare datasets (preprint)

Background: SARS-CoV-2 is straining healthcare systems globally. The burden on hospitals during the pandemic could be reduced by implementing prediction models that can discriminate between patients requiring hospitalization and those who do not. The COVID-19 vulnerability (C-19) index, a model that predicts which patients will be admitted to hospital for treatment of pneumonia or pneumonia proxies, has been developed and proposed as a valuable tool for decision making during the pandemic. However, the model is at high risk of bias according to the Prediction model Risk Of Bias ASsessment Tool and has not been externally validated. Methods: We followed the OHDSI framework for external validation to assess the reliability of the C-19 model. We evaluated the model on two different target populations: i) 41,381 patients that have SARS-CoV-2 at an outpatient or emergency room visit and ii) 9,429,285 patients that have influenza or related symptoms during an outpatient or emergency room visit, to predict their risk of hospitalization with pneumonia during the following 0 to 30 days. In total we validated the model across a network of 14 databases spanning the US, Europe, Australia and Asia. Findings: The internal validation performance of the C-19 index was a c-statistic of 0.73 and calibration was not reported by the authors. When we externally validated it by transporting it to SARS-CoV-2 data the model obtained c-statistics of 0.36, 0.53 (0.473-0.584) and 0.56 (0.488-0.636) on Spanish, US and South Korean datasets respectively. The calibration was poor with the model under-estimating risk. When validated on 12 datasets containing influenza patients across the OHDSI network the c-statistics ranged between 0.40-0.68. Interpretation: The results show that the discriminative performance of the C-19 model is low for influenza cohorts, and even worse amongst COVID-19 patients in the US, Spain and South Korea. These results suggest that C-19 should not be used to aid decision making during the COVID-19 pandemic. Our findings highlight the importance of performing external validation across a range of settings, especially when a prediction model is being extrapolated to a different population. In the field of prediction, extensive validation is required to create appropriate trust in a model.

Safety of hydroxychloroquine, alone and in combination with azithromycin, in light of rapid wide-spread use for COVID-19: a multinational, network cohort and self-controlled case series study (preprint)

BackgroundHydroxychloroquine has recently received Emergency Use Authorization by the FDA and is currently prescribed in combination with azithromycin for COVID-19 pneumonia. We studied the safety of hydroxychloroquine, alone and in combination with azithromycin. MethodsNew user cohort studies were conducted including 16 severe adverse events (SAEs). Rheumatoid arthritis patients aged 18+ and initiating hydroxychloroquine were compared to those initiating sulfasalazine and followed up over 30 days. Self-controlled case series (SCCS) were conducted to further establish safety in wider populations. Separately, SAEs associated with hydroxychloroquine-azithromycin (compared to hydroxychloroquine-amoxicillin) were studied. Data comprised 14 sources of claims data or electronic medical records from Germany, Japan, Netherlands, Spain, UK, and USA. Propensity score stratification and calibration using negative control outcomes were used to address confounding. Cox models were fitted to estimate calibrated hazard ratios (CalHRs) according to drug use. Estimates were pooled where I2<40%. ResultsOverall, 956,374 and 310,350 users of hydroxychloroquine and sulfasalazine, and 323,122 and 351,956 users of hydroxychloroquine-azithromycin and hydroxychloroquine-amoxicillin were included. No excess risk of SAEs was identified when 30-day hydroxychloroquine and sulfasalazine use were compared. SCCS confirmed these findings. However, when azithromycin was added to hydroxychloroquine, we observed an increased risk of 30-day cardiovascular mortality (CalHR2.19 [1.22-3.94]), chest pain/angina (CalHR 1.15 [95% CI 1.05-1.26]), and heart failure (CalHR 1.22 [95% CI 1.02-1.45]) ConclusionsShort-term hydroxychloroquine treatment is safe, but addition of azithromycin may induce heart failure and cardiovascular mortality, potentially due to synergistic effects on QT length. We call for caution if such combination is to be used in the management of Covid-19. Trial registration numberRegistered with EU PAS; Reference number EUPAS34497 (http://www.encepp.eu/encepp/viewResource.htm?id=34498). The full study protocol and analysis source code can be found at https://github.com/ohdsi-studies/Covid19EstimationHydroxychloroquine. Funding sourcesThis research received partial support from the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC) and Senior Research Fellowship (DPA), US National Institutes of Health, Janssen Research & Development, IQVIA, and by a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea [grant number: HI16C0992]. Personal funding included Versus Arthritis [21605] (JL), MRC-DTP [MR/K501256/1] (JL), MRC and FAME (APU). The European Health Data & Evidence Network has received funding from the Innovative Medicines Initiative 2 Joint Undertaking (JU) under grant agreement No 806968. The JU receives support from the European Unions Horizon 2020 research and innovation programme and EFPIA. No funders had a direct role in this study. The views and opinions expressed are those of the authors and do not necessarily reflect those of the Clinician Scientist Award programme, NIHR, NHS or the Department of Health, England.